BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Regulation events by Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ConcordU ] Regulation 291 ( 70) 153 ( 70) 24.05 45.75 31.53
[JULIELab ] Regulation 291 ( 91) 302 ( 91) 31.27 30.13 30.69
[ UTurku ] Regulation 291 ( 74) 194 ( 74) 25.43 38.14 30.52
[UT+DBCLS ] Regulation 291 ( 69) 169 ( 69) 23.71 40.83 30.00
[ UTokyo ] Regulation 291 ( 33) 78 ( 33) 11.34 42.31 17.89
[ UZurich ] Regulation 291 ( 34) 120 ( 34) 11.68 28.33 16.55
[ UNSW ] Regulation 291 ( 36) 161 ( 36) 12.37 22.36 15.93
[ Cam ] Regulation 291 ( 27) 74 ( 27) 9.28 36.49 14.79
[VIBGhent ] Regulation 291 ( 31) 136 ( 31) 10.65 22.79 14.52
[ NICTA ] Regulation 291 ( 43) 339 ( 43) 14.78 12.68 13.65
[UAntwerp ] Regulation 291 ( 26) 110 ( 26) 8.93 23.64 12.97
[ Team 24 ] Regulation 291 ( 22) 92 ( 22) 7.56 23.91 11.49
[ UAveiro ] Regulation 291 ( 23) 165 ( 23) 7.90 13.94 10.09
[ SCAI ] Regulation 291 ( 28) 280 ( 28) 9.62 10.00 9.81
[ USzeged ] Regulation 291 ( 15) 65 ( 15) 5.15 23.08 8.43
[CIPS-ASU ] Regulation 291 ( 33) 521 ( 33) 11.34 6.33 8.13
[CNBMadrid] Regulation 291 ( 30) 555 ( 30) 10.31 5.41 7.09
[CCP-BTMG ] Regulation 291 ( 9) 19 ( 9) 3.09 47.37 5.81
[ UNIMAN ] Regulation 291 ( 9) 47 ( 9) 3.09 19.15 5.33
[ UMich ] Regulation 291 ( 9) 235 ( 9) 3.09 3.83 3.42
[ PIKB ] Regulation 291 ( 5) 15 ( 5) 1.72 33.33 3.27
[ KoreaU ] Regulation 291 ( 2) 12 ( 2) 0.69 16.67 1.32
[ASU+HU+BU] Regulation 291 ( 1) 13 ( 1) 0.34 7.69 0.66
[ Team 09 ] Regulation 291 ( 0) 0 ( 0) 0.00 0.00 0.00
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Regulation 292 ( 65) 169 ( 65) 22.26 38.46 28.20
[UAntwerp ] Regulation 292 ( 25) 110 ( 25) 8.56 22.73 12.44
[ Team 24 ] Regulation 292 ( 22) 94 ( 22) 7.53 23.40 11.40
[CNBMadrid] Regulation 292 ( 25) 555 ( 25) 8.56 4.50 5.90
[CCP-BTMG ] Regulation 292 ( 9) 19 ( 9) 3.08 47.37 5.79
[ASU+HU+BU] Regulation 292 ( 1) 13 ( 1) 0.34 7.69 0.66
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------